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This paper develops an empirical likelihood approach to testing for the presence of stochastic 
ordering among univariate distributions based on independent random samples from each dis- 
tribution. The proposed test statistic is formed by integrating a localized empirical likelihood 
statistic with respect to the empirical distribution of the pooled sample. The asymptotic null dis- 
tribution of this test statistic is found to have a simple distribution-free representation in terms 
of standard Brownian bridge processes. The approach is used to compare the lengths of rule of 
Roman Emperors over various historical periods, including the "decline and fall" phase of the 
empire. In a simulation study, the power of the proposed test is found to improve substantially 
upon that of a competing test due to El Barmi and Mukerjee. 
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1. Introduction 

Comparing random variables in terms of their distributions can provide an understanding 
of underlying causal mechanisms and risks. In addition, knowledge of an ordering of 
distributions can be useful for increasing the efficiency of estimation procedures, as is 
well documented in the literature on order restricted inference; see, for example, the 
comprehensive monograph of Silvapulle and Sen [20] . There are many types of ordering 
for the comparison of univariate distributions. These include, with increasing generality, 
likelihood ratio ordering, uniform stochastic ordering (equivalent to hazard rate ordering), 
stochastic ordering, and increasing convex ordering (of interest in economics and actuarial 
science); see Shaked and Shanthikumar [19] for an overview. 

The aim of this paper is to develop an empirical likelihood approach to testing for 
the presence of the classical type of stochastic ordering. Such ordering often arises in the 
biomedical sciences and reliability engineering, for example, with lifetime distributions of 
human populations exposed to higher risk, or of engineering systems under greater stress. 
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The notion of stochastic ordering is due to Lehmann [11] who defined a random variable 
Xi to be stochastically larger than a random variable X2 if F\{x) < F^ix) for all x (with 
strict inequality for some a;), where -Fi and F2 are the corresponding cdfs; we write this 
as Fi y F2. For a stochastic ordering of k distributions, we write F\ y F2 y ■ ■ ■ y Fk 
if Fj(x) < Fj+i(x) for all x and j = l,...,k— 1, with strict inequality for some x and 
some j . 

There is an extensive literature on the problem of testing for equality of two distri- 
butions against the alternative that they are stochastically ordered. Lee and Wolf [10] 
proposed a Mann- Whitney- Wilcoxon- type test. Robertson and Wright [17] studied the 
corresponding likelihood test (LRT) in the one- and two-sample cases when the distribu- 
tions are discrete. They showed that the limiting distributions are chi-bar square. Their 
results indicate that, in the two-sample case, the LRT is not asymptotically distribu- 
tion free. They also obtained the least favorable distribution in this case. Other tests 
are discussed in Dykstra, Madsen and Fairbanks [3], Franck [7] and Mau [12]. For more 
than two populations, Wang [21] discussed the LRT in the multinomial case; El Barmi 
and Johnson [5] showed that the limiting distribution of his test statistic is of chi-bar 
square type and gave the expression of the weighting values. Also in the /c-sample case 
(k > 2), El Barmi and Mukerjee [6] provided an asymptotically distribution- free test 
based on the sequential testing procedure originally introduced by Hogg [8]. This test is 
applicable in both the multinomial and the continuous cases, with or without censoring. 
Recently, Baringhaus and Griibcl [1] introduced a nonparamctric two-sample test for the 
more general hypothesis of increasing convex ordering; their test is not asymptotically 
distribution-free, however, and requires the critical values to be obtained via a bootstrap 
procedure. 

The contribution of the present paper is to provide empirical likelihood based k- 
sample tests for alternatives that are stochastically ordered. The empirical likelihood 
(EL) method was originally introduced by Owen [15, 16] for the purpose of finding 
confidence regions for parameters defined by general classes of estimating equations. It 
combines the flexibility of nonparametric methods with the efficiency of likclihood-ratio- 
bascd inference. Inference based on EL has many attractive properties: estimation of 
variance is typically not required, the range of the parameter space is automatically 
respected and confidence regions have greater accuracy than those based on the Wald 
approach. Einmahl and McKeague [4] developed a localized version of EL, to allow non- 
parametric hypothesis testing, and showed via simulation studies that it outperforms (in 
terms of power) the corresponding Cramer-von Mises statistics for a variety of classical 
testing problems. Their approach is restricted to omnibus alternatives, whereas ordered 
alternatives are often more useful because they can provide a more direct interpretation 
of the result of the test. 

The development of the proposed test statistic and results on its asymptotic null 
distribution arc given in Section 2. First we consider the special case of testing whether a 
distribution function is stochastically larger than a specified distribution function, based 
on a single sample. Once the theory has been developed in this one-sample case, it is 
relatively straightforward to extend the approach to the general fc-samplc setting in which 
all the distribution functions are unknown. Section 3 presents the results of a simulation 
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study in which we find that the proposed test has superior power to the test of El Barmi 
and Mukerjee [6], which is the only previous test to have been developed for ordered 
alternatives in this setting. Section 3 also contains an application of the proposed test to 
a comparison of the lengths of rule of Roman Emperors over various historical periods. 
Some concluding remarks are given in Section 4. Proofs of the main results are collected 
in Section 5. 



2. Empirical likelihood approach 

2.1. Stochastic ordering relative to a specified distribution 

Suppose we are given a random sample Xi, X2, ■ ■ ■ ,X n from the cdf F, and we want to 
test the null hypothesis H Q : F = F versus Hi : F >~ F , where F is a specified cdf. 

Adapting the approach of Einmahl and McKeague [4] to the present setting, we first 
need to consider testing the "local" null hypothesis H$ : F(x) = Fq(x) versus the alter- 
native Hf: F{x) < Fq(x), where x is fixed. The empirical likelihood procedure in this 
case rejects Hq for small values of 



K(x) 



sup{L(F): F(x)=F (x)} 
sup{L(F): F(x)<F (x)}- 



(1) 



where the suprema are over cdfs F that are supported by the data points, L[F ) is the 
nonparametric likelihood function and, by convention, sup0 = and 0/0 = 1. For F 
having point mass pi at X,-, define the new parameters 6i =p i /tp and ipi =p,/(l — cf>), 
where < (f> = F(x) < 1. In terms of this new parameterization, with F denoting the 
empirical cdf, we need to maximize 



L(F)=up t =\ n e >\\ n ^ 



Xi<a 



Xi>x 



inF(x)< 



]n (l-F(x)) 



(2) 



subject to the constraint 



E 

: Xi<l 



i: Xi>x 



with either <fi = Fq(x) under Hq, or <fi < Fo(x) under Hf. Note that the three terms in 
the right-hand side of (2) can be maximized separately. As the constraints for the first 
two terms of (2) are the same for both the numerator and the denominator of (1), these 
terms cancel and make no contribution to lZ(x). The third term of (2) is maximized by 



Fq(x) under Hq, or 



Fq(x) A F(x) under Hf. Consequently, 

HF(x)>F {x), 
i£F(x)<F (x), 



K(x) = | 


\Fo(x)' 


nF(x) 


"1- 


-F (x)~ 


n(l-F(x)) 




[ F(x) _ 




. 1 


- F(x) - 
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with the convention that any term raised to a zero power is set to 1 . Using a second-order 
Taylor expansion of log(l + y) about y = 0, it can be shown (see the proof of the theorem 
below) that, for a given x, such that < F (x) < 1, under H§ , 



-2\ogK(x) = n(F(x) - F (x)) 2 



A Z 2 I{Z>Q), 



F{x) l-F(x) 



I[0<F(x)<F (x)]+o p (l) 



using the CLT and the continuous mapping theorem, where Z ~ N(0,1). That is, the 
asymptotic null distribution of — 21og7?.(x) is chi-bar square. 

To test Hq against Hi, we introduce the integral-type test statistic 



oo 



T n = -2 log(K{x))dF (x). 

Here the range of integration is actually restricted to the interval [Xru,Xr n )], where 
Xm and Xr n \ are the smallest and largest order statistics in the sample, because the 
integrand vanishes outside this interval. The following result gives the asymptotic null 
distribution of T n . 

Theorem 1. If Fq is continuous, then under Hq, 



where B is a standard Brownian bridge. 

Remark 1. An alternative test statistic is obtained by integrating with respect to the 
empirical cdf (instead of Fq), 



/oo 
log(ft(aO)dF(aO. 
-oo 



It can be shown using a martingale argument (see Section 5), that T* has the same 
asymptotic null distribution as T n . 



2.2. Stochastic ordering among k distributions 

Suppose now that we are given a random sample of size rij from the cdf Fj , for j = 1, . . . , k, 
the k samples are independent and we want to test the null hypothesis Hq: Fi = ■ ■ ■ = Fk 
versus Hi: F\ x • • • X Fk. We assume that the proportion Wj = rij/n of observations in 
the jth sample remains fixed as the total sample size n — > oo, with < Wj < 1 for all 
j = l,...,k. 
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Adapting the approach of Section 2.1, we now consider the localized empirical likeli- 
hood function 



K(x) 



sup{IliLi HFj)- = F j+1 (x),j = 1, . . . , fc - 1} 

sup{nj=i < = i, . . . , fc - 1} ' 



(3) 



where, in each supremum, pj is supported by the observations in the jth sample. Applying 
the same parameterization used in (2), separately for each Fj, and making the same 
cancelation in the numerator and denominator, it suffices to maximize 



n< 

3=1 



, in, (!-#,(*)) 



(4) 



subject to the constraint < <f>i = ■ ■ ■ = <pk < 1 ; or < <f>i < ■ ■ ■ < <j>k < 1, depending on 
whether it is the numerator or the denominator of (3). Here Fj is the empirical cdf based 
on the jth sample. Under the first of these constraints, (4) is maximized by <pj = F(x), 
where F is the empirical cdf of the pooled sample. Under the second constraint, this 
is the classical bioassay problem, as discussed in Robertson et al. [18], page 32, and it 
follows that (4) is maximized by 

<j> j =E vt {4>\l)j=F j {x), 

where PJ w (0|I) is the weighted least squares projection of <p = {F\ (x), . . . , Fk{x)) T onto 
I = {z6 R fc : z\ < 22 < • • • < Zfc}, with weights Wj. In passing, we mention that several al- 
gorithms have been developed for computing this projection, including the pool-adjacent- 
violators algorithm, see Robertson et al. [18]. We now have 



K(x) 



k 

n 

3=1 



r f{x) - 


n,jF 3 {x) 


' 1 


- Hx) - 


^(l-F^x)) 


VFj{x)_ 




.1 ■ 


-Fj(x). 





(5) 



under the convention that any term raised to a zero power is set to 1. 
To test H against Hi , we propose the test statistic 



T n = -2 



logK(x)dF(x) 



(6) 



The following theorem gives the asymptotic null distribution of T n . 



Theorem 2. Under Ho and assuming that the common distribution function F is con- 
tinuous, 



T n ^^Twj [ 

7=1 J ° 



i(l-i) 



dt, 



(7) 
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Table 1. Selected critical points of T, 



k 


Significance level a 




0.01 


0.05 


0.10 


2 


3.185 


1.821 


1.288 


3 


4.128 


2.613 


1.943 


4 


4.663 


3.107 


2.404 


5 


5.144 


3.470 


2.701 



where B = {B\/ ^Jw\, B^j 'y/w2, ■ ■ ■ , B^j \JvJk) T , the processes Bi, B2, ■ ■ ■ , B^ are indepen- 
dent standard Brownian bridges, and B = ^2j=\ V^jBj- 

Remark 2. For the two-sample case, it can be shown that the limiting distribution in 
the above result coincides with that in the one-sample case (Theorem 1); the equivalence 
arises from the fact that B = t/w^Bi — ^fw\B2 is a standard Brownian bridge. Moreover, 
when testing against the unrestricted alternative F\ 7^ F2 , the limiting distribution of the 
corresponding test statistic (see Einmahl and McKeague [4], Theorem 2a) is the same 
apart from the presence of the indicator I{B(t) > 0) in the integrand. 



3. Numerical examples 

In this section we discuss some numerical examples illustrating the proposed test for a 
comparison of two or more distributions developed in Section 2.2. 

To implement the proposed test we first need to obtain critical values for T n . The 
null distribution of T n is not tractable, even asymptotically, but it is asymptotically 
distribution free. We use simulation to approximate selected critical values as pro- 
vided in Table 1. These critical values are based on 100 000 data sets distributed as 
7V(0, 1), with sample sizes of ni = 100, i = l,...,k, in each case. The (Fortran) program 
used to compute the critical values in Table 1 is available online in the supplemental 
files. 

3.1. Simulation study 

Here we present the results of a simulation study designed to compare the performance 
of T n with the test statistic S n of El Barmi and Mukerjee [6], which is defined as the 
maximum of a sequence of (one-sided) two-sample Kolmogorov-Smirnov test statistics. 
As far as we know, S n is the only previously developed test statistic when k > 3. 

Tables 2 and 3 give the results for a variety of distributions and sample sizes, for 
k = 2 and k = 3, respectively. In each case, 10 000 data sets were used to approximate 
the power at a nominal level of a = 0.05, with critical values for T„ taken from Table 1; 
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Table 2. Power 


comparison 


of tests for 


stochastic 


ordering 


of k = 2 


distributions 


at level 


a = 0.05 
















Distributions 




77.1 — DU, 


~ on 

77.2 — OU 


„ on 

ni — ou 


, 712 — OU 


ni = 50, 7i2 = 50 






T„ 


Sn 


T„ 




T n 


S a 


Uni(0,l) 


Uni(0,l) 


0.064 


0.038 


0.051 


0.045 


0.051 


0.036 


Uni(0,l.l) 


Uni(0, 1) 


0.143 


0.104 


0.162 


0.111 


0.199 


0.125 


Uni(0, 2) 


Uni(0, 1) 


0.911 


0.816 


0.912 


0.818 


0.908 


0.815 


Uni(0.1,l.l) 


Uni(0, 1) 


0.377 


0.244 


0.357 


0.246 


0.468 


0.287 


Exp(l) 


Exp(l) 


0.063 


0.037 


0.048 


0.041 


0.047 


0.036 


Exp(l) 


Exp(l.l) 


0.123 


0.076 


0.091 


0.068 


0.108 


0.076 


Exp(l) 


Exp(2) 


0.782 


0.716 


0.813 


0.718 


0.909 


0.815 


0.1 + Exp(l) 


Exp(l) 


0.207 


0.118 


0.137 


0.105 


0.195 


0.127 


N(0,1) 


N(0,1) 


0.063 


0.037 


0.049 


0.040 


0.051 


0.036 


JV(0.1,1) 


N(0,1) 


0.132 


0.081 


0.100 


0.079 


0.122 


0.079 


JV(0.5,1) 


N(0,1) 


0.646 


0.530 


0.690 


0.540 


0.771 


0.628 


N(l,l) 


N(0,1) 


0.992 


0.975 


0.991 


0.975 


0.993 


0.976 



critical values for S n are obtained from its asymptotic distribution, which is available in 
a closed form. In all cases, T n has greater power than S n and has better agreement with 
the nominal level of the test. 



Table 3. Power 


comparison 


of tests for stochastic ordering 


of k = 3 


distributions 


at level 


a = 0.05 














Distributions 






n\ = 7i2 = 


71 3 =30 


77i = 712 = 


= 713 = 50 


Ft 


F 2 




T n 


Sn 


T n 


S ii 


Uni(0,l) 


Uni(0, 1) 


Uni(0,l) 


0.038 


0.033 


0.045 


0.039 


Uni(0,l.l) 


Uni(0, 1) 


Uni(0,l) 


0.455 


0.370 


0.740 


0.647 


Uni(0,l.l) 


Uni(0,l.l) 


Uni(0, 1) 


0.389 


0.319 


0.651 


0.633 


Uni(0.1,l.l) 


Uni(0, 1) 


Uni(0, 1) 


0.948 


0.884 


0.999 


0.885 


Exp(l) 


Exp(l) 


Exp(l) 


0.041 


0.019 


0.049 


0.045 


Exp(l) 


Exp(l) 


Exp(l.l) 


0.076 


0.033 


0.098 


0.067 


Exp(l) 


Exp(l.l) 


Exp(l.l) 


0.067 


0.029 


0.098 


0.073 


Exp(l) 


Exp(l.l) 


Exp(1.2) 


0.116 


0.046 


0.171 


0.109 


Exp(l) 


Exp(1.25) 


Exp(1.5) 


0.313 


0.121 


0.507 


0.321 


N(0,1) 


iV(0,l) 


iV(0,l) 


0.042 


0.035 


0.049 


0.035 


7V(0.1,1) 


AT(0,1) 


iV(0,l) 


0.272 


0.183 


0.423 


0.292 


AT(0.1,1) 


JV(0.1,1) 


iV(0,l) 


0.246 


0.151 


0.393 


0.249 


JV(0.5,1) 


iV(0.25,l) 


iV(0,l) 


1.000 


0.993 


1.000 


1.000 
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Reigns of Roman Emperors 




O <—\ 1 1 1 — 

10 20 30 

Duration of reign (years) 



crisis = crisis = 1 



Figure 1. Empirical survival functions of durations of rule of the first 70 Roman Emperors 
before 235 AD (crisis = 0), and after 235 AD (crisis = 1). 

3.2. Lengths of rule of Roman Emperors 

A recent article of Khmaladzc, Brownrigg and Haywood [9] reached the interesting con- 
clusion that the lengths of rule of Roman Emperors were exponentially distributed, im- 
plying that their reigns ceased unexpectedly ("brittle power"). It is also of interest to 
examine whether there were changes in the distribution of rule lengths, especially during 
the "decline and fall" phase of the empire. We use the list of n = 70 Roman Emperors 
from Augustus to Thcodossius, covering 27 BC to 395 AD. Our analysis is based on 
the chronology of Parkin (see Khmaladzc et al. [9] for further details). The (Fortran) 
programs used for the two analyzes arc available online in the supplemental files. 

First we consider whether there is an effect on duration of rule due to the Crisis of 
the Third Century (235-284 AD), when the Roman Empire nearly collapsed under the 
pressure of civil war (among other things!). Figure 1 shows the empirical survival function 
of durations of rule for the Principate (27 BC-235 AD), which was the relatively stable 
period preceding the Crisis, compared with the period after 235 AD; the sample sizes 
are n\ = 29 and ri2 =41, respectively. The two distributions appear to be exponential, 
and the likelihood ratio test of stochastic ordering under this assumption has p-valuc 
0.195; the corresponding unrestricted likelihood-ratio test has p- value 0.390. Applying 
our proposed test (with k = 2) to assess whether the duration of rule is stochastically 
shorter after the Principate, we obtain T n = 0.3161 with a p- value of 0.424. This compares 
with a p- value of 0.575 based on S n . 

The period 285-395 AD forms part of what is known as the Dominate, the despotic 
later phase of the empire. Inspection of Figure 2 suggests that the exponential hypothesis 
is not tenable for each separate period, so our nonparametric approach is more reasonable. 
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Reigns of Roman Emperors 




Figure 2. Empirical survival functions of durations of rule during the Principate, 27 BC-235 
AD (period = 1), the Crisis, 235-284 AD (period = 2) and the Dominate, 284-395 AD 
(period = 3). 



The plot also suggests that the rule lengths are stochastically ordered as Dominate y 
Principate y Crisis. Applying our approach to formally test this hypothesis, we find 
that T n has a p-valuc of 0.0002, compared with a p-value of 0.0017 for S n . Under the 
assumption of exponential distributions, the likelihood ratio test has p-value less than 
0.0007. 



4. Discussion 

In this paper we have developed a novel empirical likelihood approach to the important 
problem of nonparametrically testing for the presence of stochastic ordering based on k 
independent samples. The proposed tests are computationally efficient to implement, and 
could be used with massive data sets because they do not rely on the bootstrap or any 
other simulation technique, and they reduce to a local test for an ordering of binomial 
probabilities, which only requires a single sweep through the pooled data in the k groups. 

Various extensions of the proposed tests are possible. In change-point problems, for 
example, it is of interest to test whether there is a sudden change in the distribution 
of a sequence of independent random variables X\, . . . ,X n . Einmahl and McKeague [4] 
developed an EL-bascd change-point test for the presence of an (unknown) change-point 
r G {2, . . . , n} such that 

X\, . . . ,aV_i ~ F\ and X T , . . . ,X n ~ F%. 

They only considered the unrestricted alternative F\ ^ i*2, but it is also of interest to 
consider the ordered alternative F% y F2 ■ This can be done by extending the two-sample 
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case to allow the sample sizes to depend on an additional local parameter, namely t € 
[1/n, 1), with ni = \nt\ and n 2 = n — \nt\. The resulting test statistic has a limiting 
distribution of the same form as in Theorem 2 of Eimnahl and McKeague [4] , involving 
the integral of a four-sided tied-down Wiener process Wo(t,y), except that the integrand 
now includes the indicator I(Wo(t,y) > 0). 

Our approach also naturally extends to non-monotonic alternatives, namely to testing 
whether Fi , F 2 , . . . , Fj. are isotonic with respect to a quasi-ordcr on {1, 2, . . . , k}. A re- 
lation < on {1,2, ...,k} is a quasi-order if it is reflexive and transitive (and a partial 
order if, in addition, it is antisymmetric) . We say that i*\ , i*2 > • • • > Fk are isotonic with 
respect to < if >- Fj whenever i<j. Examples of such ordered alternatives include 

Fi >- Fi, i = 2, . . . ,k (tree ordering) and Fi y F2 > >- i*i -< F ia+1 -< < F k , where io 

is known (umbrella ordering). The localized empirical likelihood (3) extends naturally to 
such ordered alternatives, the only difference being that in <pj — E w {cj)\X)j the set I is 
now the isotonic cone corresponding to <. For example, in the case of tree ordering, the 
cone becomes l={z£ M. k : z\ < Zi, i = 2, . . . , fc}. The (f>j can be computed using quadratic 
programming or algorithms described in Robertson, Wright and Dykstra [18], one of the 
most general being the lower-sets algorithm. The limiting distribution of the resulting 
test statistic is obtained by taking X in (7) as the isotonic cone corresponding to <. 

An important and challenging problem for future research in this area would be to 
develop EL-based tests for stochastic ordering based on censored data. EL methods are 
well developed for the comparison of survival functions from right-censored data, see 
McKeague and Zhao [13, 14], but these methods only apply to omnibus alternatives. 
The complication in extending the present tests to right-censored data arises because 
the EL ratio would then no longer have such an explicit form as in (5), and Lagrange 
multipliers would be involved. This extension is beyond the scope of the present paper. 

5. Proofs 

Proof of Theorem 1. For < e < 1, let x £ ,y e be real numbers such that Fq(x e ) = 
1 — Fo(y £ ) = e/2. Then decompose the test statistic as T n = T\ n + Tm, where 



By appealing to Theorem 4.2 of Billingslcy [2], note that, to complete the proof of the 
theorem, it suffices to show that for fixed e, 



v. 



2 




and 






as n — > 00, and, for each 8 > 0, that limsup. 



n 



00 



P{\T 2n \ ><5)^0 as e^O. 
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First consider T\ n . Using the inequality | log(l + y) —y + y 2 /2\ < \y\ 3 /3 when \y \ < 1/2, 
the Glivcnko-Cantclli theorem and Donskcr's theorem, we have 



lim sup sup 

n-s-oo x&[x e ,y s ] 



log(nx)) + ^(F( X )-F (x)f 



1 



1 



<limsup sup — \F(x) — Fq(s 

n->oo X £[x E ,y E ] « 



1 



F(x) 1-F(x) 
1 



I[F(x)<F (x)} 



F(x) l-F(x) 



= 0, 



almost surely. Then, noting that F(x) = f (Fq(x)), where f is the empirical cdf of Vi = 
Fo(Xi) ~ U(0, 1), i = 1, . . . ,n, and changing variables in the integration to t = Fq(x), it 
follows that 



Tin 



l-e/2 



n(T(t)-t) 



e/2 

l-e/2 fj^2 



1 



1 



12 *(!-«) 



r(t) i-r(t) 
<0] dt + o p (l), 



I[Vn(t (t) - t) < 0] dt + o p (l) 



(9) 



where C/(£) = v / n(f (t) — i) is the uniform empirical process. Note that (for any fixed 
< £ < 1) the functional 



l-e/2 



/ft) 2 
12 t(l-t) 



/(/(*)< 0)di, /€fl[0,l], 



is continuous when the Skorohod space -D[0, 1] is equipped with the uniform norm. By 
Donsker's theorem, U converges weakly to B in D[0, 1], so applying the continuous map- 
ping theorem to the leading term in (9) establishes (8). 

Finally we need to verify the claim concerning Ti n . This follows immediately from a 
corresponding result in Einmahl and McKeague [4] , who considered the test of the null 
hypothesis F = Fq versus the (omnibus) alternative F ^ Fq , with the same integral-type 
test statistic as T n except that the integrand does not vanish when F(x) > Fq(x). This 
completes the proof. □ 



Proof for Remark 1. The asymptotic distribution of T* can be obtained following the 
same steps as the proof of Theorem 1, except that the leading term in T\ n now becomes 



l-e/2 



12 *(!-*) 



i[u(t) < o] dr(t) 



l-e/2 



e/2 



V(t-)dT(t) + o p (l), 



where 



V(t) = 



t(l-t) 



I[U(t)<Q,e/2<t<l-e/2]. 
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Note that 

M(t) = t(t)- [ [l-f(s-)](l-s)- 1 ds 
Jo 

is a martingale wrt to the natural filtration defined by T, and its predictable quadratic 



variation process is (M)(t) =n 1 J Q [1 — f (s— )](1 — s) 1 ds. Also note that V(t—) is a 
because it is 

V(t-)dt(t) 



predictable process because it is adapted and left-continuous. Write 

"1-6/2 

l-e/2 fl-e/2 

7(t-)dM(*)+ / F(t-)[l-f(t-)](l-t)- 1 dt. 

/2 Je/2 

Using a basic property of martingale integrals, the second moment of the first term above 
is 

£ f 1 8/ V(H 2 d(M)(t) = 0(l/n), 

Je/2 

so this term tends in probability to zero. The second term in the above display can be 
handled in the same way as the main term T\ n in the proof of Theorem 1 . and has the 
same limit distribution. □ 

Proof of Theorem 2. The proof is similar to the proof of Theorem 1, so we only 
indicate the main steps. Using the Taylor expansion of log(l + y), as before, and the 
(uniform) consistency of Fj as an estimator of Fj = F (see, e.g., El Barmi and Mukcr- 
jee [6], page 253), for each fixed x, such that < t = F(x) < 1, we have 



-2\o E n{x) = Y,n j (FAx)-F{x)? 1 



Fj(x) 1-Fjix) 



■Op(l) 



A [ y /E(F j (x)-F{x))-^(F(x)-F(x))} 2 

F(x)(l-F(x)) +op{l} 



■j 



td-t) 

where U = {Ui/^/wl, U 2 /y/w^, Uk/y/wk) T , Uj(t) = ^/n~{Fj{x) - F(x)) arc indepen- 
dent uniform empirical processes, and U = 5Z 7 '=i V^jUj- Donsker's theorem and the 
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continuous mapping theorem have been used as before, but we have also used the fact 
that -E W (-|X) is a continuous function on R fe . □ 
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grams as well as the data used in the Roman Emperors example, and the program used 
to compute the critical values in Table 1. 
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